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[57] ABSTRACT 

A method for controlling a computer by inputting an analog 
signal into the computer to control a web browser software 
application. The analog signal contains a trigger signal 
which activates proprietary software, and a product identi- 
fier. The proprietary software launches the web browser 
application on the computer, extracts the product identifier, 
and creates an appended data string by appending server 
address (URL) routing information to the product identifier 
information. The appended data string is automatically 
inserted into the web browser as keystroke data and routed 
to an advertiser reference server. The appended routing 
information directs communication to the advertiser refer- 
ence server which contains a cross-referenced database of 
advertiser product identifier information and associated 
advertiser server URLs. The advertiser server URL and a 
request for product information relevant to the product 
identifier is returned to the computer web browser where it 
is automatically redirected to the advertiser server contain- 
ing the advertiser product information. The advertiser prod- 
uct information is then returned to the computer for display. 

18 Claims, 6 Drawing Sheets 
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METHOD FOR CONTROLLING A region having a defined location. A program is broadcasted 

COMPUTER WITH AN AUDIO SIGNAL having embedded therein a routing signal having routing 

information contained therein. The routing signal is then 
This application is related to copending U.S. patent extracted from the broadcast. Thereafter, a personal corn- 
application Ser. No. 09/151,471, entitled, "METHOD FOR 5 puteris controlled to allow a user to retrieve the information 
INTERFACING SCANNED PRODUCT INFORMATION from a storage region at the defined location, which defined 
WITH A SOURCE FOR THE PRODUCT OVER A GLO- location is located with the extracted routing information, 
BAL NETWORK" filed of even date herewith. providing it at the personal computer for use by the user. 

TECHNICAL FIELD OF THE INVENTION 30 BRIEF DESCRIPTION OF THE DRAWINGS 

This invention is related to a method of computer control, For a more complete understanding of the present inven- 

and particularly for automatically directing a web browser tion and the advantages thereof, reference is now made to 

application on the computer to retrieve and display infer- the following description taken in conjunction with the 

mation in response to an analog signal. ^ accompanying Drawings in which: 

BACKGROUND OF THE INVENTION FIG * 1 illustrates a block diagram of the preferred 

embodiment; 

With the growing numbers of computer users connecting FIG. 2 illustrates the computer components employed in 

to the "Internet," many companies are seeking the substan- m ^ embodiment* 

tial commercial opportunities presented by such a large user ^ n „ T „ - .,. ' . . , , , 
u„ c „ i * u i u- u • * n 20 HO. J illustrates system interactions over a global net- 
base. For example, one technology which exists allows a ^ 3 & 

television ("TV") signal to trigger a computer response in ' 

which the consumer will be guided to a personalized web FIGS - 4fl " 4e illustrate the various message packets trans- 
page. The source of the triggering signal may be a TV, video mitted between the source PC and network servers used in 
tape recorder, or radio. For example, if a viewer is watching 25 tne preferred embodiment; and 

a TV program in which an advertiser offers viewer voting, FIG. 5 is a flowchart depicting operation of the system 

the advertiser may transmit a unique signal within the according to the preferred embodiment, 

television signal which controls a program known as a FIG. 6 illustrates a flowchart of actions taken by the 

"browser" on the viewer's computer to automatically dis- Advertiser Reference Server ("ARS") server; 

play the advertiser's web page. The viewer then simply 30 FIG 7 illustrates a flowchart of the interactive process 
makes a selection which is then transmitted back to the 



advertiser. 



between the source computer and ARS; 



_ j . FIG. 8 illustrates a web browser page receiving the 

In order to provide the viewer with the capability of modified URL/advertiser product data according to the 

responding to a wide variety of companies using this pre f erre d embodiment; 

technology, a database of company information and Uni- -ic PT - „ ... . „ . 

form Resource Locator ("URL") codes is necessarily main- ™' . 9 * Simphfied W ° ck dl3gram ° f the 

tained in the viewer's computer, requiring continuous dlsclosed embodiment; 

updates. URLs are short strings of data that identify . FIG * 10 illustrates a more detailed, simplified block 

resources on the Internet: documents, images, downloadable diagram of the embodiment of FIG. 9; 

files, services, electronic mailboxes, and other resources. 40 FIG. 11 illustrates a diagrammatic view of a method for 

URLs make resources available under a variety of naming performing the routing operation; 

schemes and access methods such as HTTP, FTP, and FIG. 12 illustrates a block diagram of an alternate 

Internet mail, addressable in the same simple way. URLs embodiment utilizing an optical region in the video image 

reduce the tedium of "login to this server, then issue this for generating the routing information; 

magic command . " down to a single click. The Internet 45 FIG. 13 illustrates a block diagram illustrating the gen- 

Ttt^ , 10 1 SPCC U y r Catl ° n ° f fikS ° n ° ther SerVCfS - e ^ion of a profile with the disclosed embodiment; 

A URL includes the type or resource being accessed (e.g., ^ A . lt _ B 

Web, gopher, FTP), the address of the server, and the ™" 14 iH^trates a flowchart for generating the profile 

location of the file. The URL can point to any file on any and St0rmg at the ARS; and 

networked computer. Current technology requires the 50 FIG * \ s illustrates a flowchart for processing the profile 

viewer to perform periodic updates to obtain the most information when information is routed to a user, 
current URL database. This aspect of the current technology 

is cumbersome since the update process requires download- ^ I AILED DESCRIFI ION OF I HE 
ing information to the viewer's computer. Moreover, the i in vein iiuin 
likelihood for error in performing the update, and the 55 Referring now to FIG. 1, there is illustrated a block 
necessity of redoing the update in the event of a later diagram of a system for controlling a personal computer 
computer crash, further complicates the process. (« PC ») m via an audio tone transmitted over a wireless 
Additionally, current technologies are limited in the number system utilizing a TV. In the embodiment illustrated in FIG. 
of companies which may be stored in the database. This is there is provided a transmission station 101 and a receive 
a significant limitation since worldwide access presented by 60 stat ion 117 that are connected via a communication link 108. 
the Internet and the increasing number of companies con- Th e transmission station 101 is comprised of a television 
necting to perform on-line commerce necessitates a large program source 104, which is operable to generate a pro- 
database. g ram i n the form of a broadcast signal comprised of video 
SUMMARY OF THE INVENTION anC * auc ^°' "^* s ls transmitted via conventional techniques 

65 along channels in the appropriate frequencies. The program 

The present invention disclosed and claimed herein com- source is input to a mixing device 106, which mixing device 

prises a method for retrieving information from a storage is operable to mix in an audio signal. This audio signal is 
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derived from an audio source 100 which comprises a coded The Internet is one of the most utilized networks for 
audio signal which is then modulated onto a carrier which is interconnecting distributed computer systems and allows 
combined with the television program source 104. This users of these computer systems to exchange data all over 
signal combining can be done at the audio level, or it can the world. Connected to the Internet are many private 
even be done at the RF level in the from of a different carrier. 5 networks, for example, corporate or commercial networks. 
* However, the preferred method is to merely sum the audio Standard protocols, such as the Transport Control Protocol 
signal from the modulator 102 into the audio channel of the ("TCP") and the Internet Protocol ("IP") provide a conve- 
program that is generated by the television program source nient method for communicating across these diverse net- 
104. The output thereof is provided from the mixing device works. These protocols dictate how data are formatted and 
106 in the form of broadcast signal to an antenna 107, which 30 communicated. As a characteristic of the Internet, the pro- 
transmits the information over the communication link 108 tocols are la y cred 10 an IP stack - At m S her levels of the IP 
to an antenna 109 on the receive side. stac *> s ^ h u as the Wharton layer (where HTTP is 
~ iL ■ -j r t_ 1 employed), the user information is more readily visible, 
On the .receive side of the systeni, 1 1 conventional receiver ^ > t leyd such ag ^ Qetwork ^ (wfaere 

110, such as a television is provided This television pro- Tcp/ip afe ^ data can mml be observed ag 

vides a speaker output which provides the user with an 15 packets or a stream of rapidly moving digital signals 

audible signal. This is typically associated with the program. Superimposed on the Internet is a standard protocol interface 

However, the receiver 110 in the disclosed embodiment, also f or accessing Web resources, such servers, files, Web pages, 

provides an audio output jack, this being the type RCAjack. ma n mesS ages, and the like. One way that Web resources can 

This jack is utilized to provide an audio output signal on a be accessed is by browsers made by Netscape® and 

line 113 which is represented by an audio signal 111. This 20 Microsoft Internet Explorer®. 

line 113 provides all of the audio that is received over the Referring again now to FIG. 1, the user can load this 

communication link 108 to the PC 112 in the audio input program with the appropriate keystrokes such that a browser 

port on the PC 112. However, it should be understood that, window will be displayed on a display 118. In one 

although a direct connection is illustrated from the receiver embodiment, the user can run the browser program on the 

110 to the PC 112, there actually could be a microphone 25 PC 112 such that the browser window is displayed on the 

pickup at the PC 112 which could pick the audio signal up. display 118. While watching a preferred program, the user 

In the disclosed embodiment the audio signal generated by can also view display 118. When an audio signal is received 

the advertiser data input device 100 is audible to the human by the receiver 110 and the encoded information is contained 

ear and, therefore, can be heard by the user. Therefore, no therein that was input thereto by the advertiser, the PC 112 

special filters are needed to provide this audio to the PC 112. 30 will then perform a number of operations. The first 

The PC 112 is operable to run programs thereon which operation, according to the disclosed embodiment, is to 

typically are stored in a program file area 116. These extract the audio information within the received audio 

programs can be any type of programs such as word pro- signal in the form of digital data, and then transmit this 

cessing programs, application programs, etc. In the dis- digital data to a defined location on the global communica- 

closed embodiment, the program that is utilized in the 35 tion network via a modem connection 114. This connection 

system is what is referred to as a "browser" The PC 112 runs w iH be described hereinbelow. This information will be 

a browser program to facilitate the access of information on relayed to a proprietary location and the instructions sent 

the network, for example, a global communication network Dack t0 tne pc U2 as to the location of the advertiser 

known as the "Internet" or the World-Wide-Web ("Web"). associated with the code, and the PC 112 will then effect a 

The browser is a hypertext-linked application used for 40 communication link to that location such that the user can 

accessing information. Hypertext is a term used to describe view 011 the display 118 information that the advertiser, by 

a particular organization of information within a data pro- tne fact of putting the tone onto the broadcast channel, 

cessing system, and its presentation to a user. It exploits the desires the viewer to view. This information can be in the 

computer's ability to link together information from a wide form of interactive programs, data files, etc. In one example, 

variety of sources to provide the user with the ability to 45 wnen an advertisement appears on the television, the tone 

explore a particular topic. The traditional style of presenta- can bc generated and then additional data displayed on the 

tion used in books employs an organization of the informa- display 118. Additionally, a streaming video program could 

tion which is imposed upon it by limitations of the medium, be played on the PC received over the network, which 

namely fixed sized, sequential paper pages. Hypertext streaming video program is actually longer than the adver- 

systems, however, use a large number of units of text or 50 tisin g segment on the broadcast. Another example would be 

other types of data such as image information, graphical a sports game that would broadcast the tone in order to allow 

information, video information, or sound information, which a user access to information that is not available over the 

can vary in size. A collection of such units of information is broadcast network, such as additional statistics associated 

termed a hypertext document, or where the hypertext docu- wltn tne sports program, etc. 

ments employ information other than text, hypermedia 55 By utilizing the system described herein with respect to 

documents. Multimedia communications may use the the disclosed embodiment of FIG. 1, an advertiser is allowed 

Hypertext Transfer Protocol ("HTTP"), and files or format- the ability to control a user's PC 112 through the use of tones 

ted data may use the Hypertext Markup Language embedded within a program audio signal. As will descried 

("HTML"). This formatting language provides for a min- hereinbelow, the disclosed embodiment utilizes particular 

gling of text, graphics, sound, video, and hypertext links by 60 routing information stored in the PC 112 which allows the 

"tagging" a text document using HTML. Data encoded encoded information in the received audio signal to route 

using HTML is often referred to as an "HTML document," this information to a desired location on the network and 

an "HTML page," or a "home page." These documents and then allow other routing information to be returned to the PC 

other Internet resources may be accessed across the network 112 for control thereof to route the PC 112 to the appropriate 

by means of a network addressing scheme which uses a 65 location associated with that code. 

locator referred to as a Uniform Resource Locator ("URL"), Referring now to FIG. 2, there is illustrated a computer 

for example, "http://www.digital.com." 204, similar to computer 112, connected to display infor- 
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mation on display 118. The computer 204 comprises an 
internal audio or "sound" card 206 for receiving the trans- 
mitted audio signal through receive antenna 109 and 
receiver 110. The sound card 206 typically contains analog- 
to-digital circuitry for converting the analog audio signal 
into a digital signal. The digital signal may then be more 
easily manipulated by software programs. The receiver 110 
separates the audio signal from the video signal. A special 
trigger signal located within the transmitted advertiser audio 
signal triggers proprietary software running on the computer 
204 which launches a communication application, in this 
particular embodiment, the web browser application located 
on the PC 204. Coded advertiser information contained 
within the audio signal is then extracted and appended with 
the address of a proprietary server located on the commu- 
nication network. The remote server address is in the form 
of a URL. This appended data, in addition to other control 
codes, is inserted directly into the web browser application 
for automatic routing to the communication network. The 
web browser running on PC 204, and communicating to the 
network with a through an internal modem 208, in this 
embodiment, transmits the advertiser information to the 
remote server. The remote server cross-references the adver- 
tiser product information to the address of the advertiser 
server located on the network. The address of the advertiser 
server is routed back through the PC 204 web browser to the 
advertiser server. The advertiser product information is 
returned to PC 204 to be presented to the viewer on display 
118. In this particular embodiment, the particular advertiser 
product information displayed is contained within the adver- 
tiser's web page 212. As mentioned above, the audio signal 
is audible to the human ear. Therefore the audio signal, as 
emitted from the TV speakers, may be input to the sound 
card 206 via a microphone. Furthermore, the audio signal 
need not be a real-time broadcast, but may be on video tapes, 
CDs, DVD, or other media which may be displayed at a later 
date. With the imminent implementation of high definition 
digital television, the audio signal output from the TV may 
also be digital. Therefore, direct input into a sound card for 
AID purposes may not be necessary, but alternative inter- 
facing techniques to accommodate digital-to-digital signal 
formats would apply. 

Referring now to FIG. 3, there is illustrated a source PC 
302, similar to PCs 204 and 112, connected to a global 
communication network 306 through an interface 304. In 
this embodiment, the audio signal 111 is received by PC 302 
through its sound card 206. The audio signal 111 comprises 
a trigger signal which triggers proprietary software into 
launching a web browser application residing on the PC 302. 
The audio signal 111 also comprises advertiser product 
information which is extracted and appended with URL 
information of an Advertiser Reference Server ("ARS") 308. 
The ARS 308 is a system disposed on the network that is 
defined as the location to which data in the audio signal 111 
is to be routed. As such, data in the audio signal 111 will 
always be routed to the ARS 308, since a URL is unique on 
the network system. Connected to the ARS 308 is a database 
310 of product codes and associated manufacturer URLs. 
The database 310 undergoes a continual update process 
which is transparent to the user. As companies sign-on, e.g., 
subscribe, to this technology, manufacturer and product 
information is added to the database 310 without interrupt- 
ing operation of the source PC 302 with frequent updates. 
When the advertiser server address URL is obtained from 
the ARS database 310, it and the request for the particular 
advertiser product information is automatically routed back 
through the web browser on PC 302, over to the respective 
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advertiser , server for retrieval of the advertiser product 
information to the PC 302. It should be noted that although 
the disclosed invention discusses a global communication 
network, the system is also applicable to LANs, WANs, and 

5 peer-to-pcer network configurations. It should be noted that 
the disclosed architecture is not limited to a single source PC 
302, but may comprise a plurality of source PCs, e.g., PC 
300 and PC 303. Moreover, a plurality of ARS 308 systems 
and advertiser servers 312 may be implemented, e.g., ARS 

10 314, and advertiser server A 316, respectively. 

The information transactions, in general, which occur 
between the networked systems of this embodiment, over 
the communication network, are the following. The web 
browser running on source PC 302 transmits a message 

15 packet to the ARS 308 over Path "A." The ARS 308 decodes 
the message packet and performs a cross-reference function 
with product information extracted from the received mes- 
sage packet to obtain the address of an advertiser server 312. 
A new message packet is assembled comprising the adver- 

20 tiser server 312 address, and sent back to the source PC 302 
over Path "B." A"handoff" operation is performed whereby 
the source PC 302 browser simply reroutes the information 
on to the advertiser server 312 over Path "C," with the 
appropriate source and destination address appended. The 

25 advertiser server 312 receives and decodes the message 
packet. The request- for-advertiser-product -information is 
extracted and the advertiser 312 retrieves the requested 
information from its database for transmission back to the 
source PC 302 over Path "D." The source PC 302 then 

30 processes the information, i.e., for display to the viewer. The 
optional Path "E" is discussed hereinbelow. It should be 
noted that the disclosed methods are not limited to only 
browser communication applications, but may 
accommodate, with sufficient modifications by one skilled in 

35 the art, other communication applications used to transmit 
information over the Internet or communication network. 

Referring now to FIG. 4#, the message packet 400 sent 
from the source PC 302 to ARS 308 via Path "A" comprises 
several fields. One field comprises the URL of the ARS 308 

40 which indicates where the message packet is to be sent. 
Another field comprises the advertiser product code or other 
information derived from the audio signal 111, and any 
additional overhead information required for a given trans- 
action. The product code provides a link to the address of the 

45 advertiser server 312, located in the database 310. Yet 
another field comprises the network address of the source 
PC 302. In general, network transmissions are effected in 
packets of information, each packet providing a destination 
address, a source address, and data. These packets vary 

50 depending upon the network transmission protocol utilized 
for communication. Although the protocols utilized in the 
disclosed embodiment are of a conventional protocol suite 
commonly known as TCP/IP, it should be understood that 
any protocols providing the similar basic functions can be 

55 used, with the primary requirement that a browser can 
forward the routing information to the desired URL in 
response to keystrokes being input to a PC. However, it 
should be understood that any protocol can be used, with the 
primary requirement that a browser can forward the product 

60 information to the desired URL in response to keystrokes 
being input to a PC. Within the context of this disclosure, 
"message packet" shall refer to and comprise the destination 
URL, product information, and source address, even though 
more than a single packet must be transmitted to effect such 

65 a transmission. 

Upon receipt of the message packet 400 from source PC 
302, ARS 308 processes the information in accordance with 
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instructions embedded in the overhead information. The where the data is discarded. In function block 522, the 

ARS 308 specifically will extract the product code informa- program then signals for a retransmission of the data. The 

tion from the received packet 400 and, once extracted, will system then waits for the next trigger signal, in decision 

then decode this product code information. Once decoded, block 500. If properly authenticated in decision block 506, 

this information is then compared with data contained within 5 program flow continues through the "Y" signal path where 

the ARS advertiser database 310 to determine if there is a the data is then used to launch the web browser application, 

"hit." If there is no "hit" indicating a match, then informa- as indicated in function block 508. In function block 510, the 

tion is returned to the browser indicating such. If there is a web browser receives the URL data, which is then auto- 

"hit," a packet 402 is assembled which comprises the matically routed through the computer modem 208 to the 

address of the source PC 302, and information instructing 3Q network interface 304 and ultimately to the network 306. In 

the source PC 302 as to how to access, directly in a function block 514, the ARS 308 responds by returning the 

"handofT operation, another location on the network, that of URL of advertiser server 312 to the PC 302. 

an advertiser server 312. This type of construction is rela- In function block 516, the web browser running on the 

lively conventional with browsers such as Netscape® and source PC 302, receives the advertiser URL information 

Microsoft Internet Explorer® and, rather than displaying from the ARS 308, and transmits the URL for the product 

information from the ARS 308, the source PC 302 can then file t0 the advertiser server 312. In block 518, the advertiser 

access the advertiser server 312. The ARS 308 transmits the s*™* 312 responds by sending the product information to 

packet 402 back to source PC 302 over Path "B." Referring the source PC 302 for processing. 

now to FIG. 46, the message packet 402 comprises the The user ma y obtain the benefits of this architecture by 
address of the source PC 302, the URL of the advertiser n sun Ply downloading the proprietary software over the net- 
server 312 embedded within instructional code, and the URL 20 J* 0 *- °< her methods for obtaining the software are well- 
of the ARS 308 known; for example, by CD, diskette, or pre-loaded hard 

Upon receipt of the message packet 402 by the source PC n r . . , iL . .„ A t , a , 4 c 

~ M r , r , * r . \ , , , . Referring now to FIG. 6, there is illustrated a flowchart of 

302, the message packed 402 is disassembled to obtain the ^ thc ^ m ^ wheQ living the 

pertinent .rouUng information for assembly of a new message 25 m packet 400 ffom the pc 302 Ifl d J sim 
packet 404. The web browser running on source PC 302 is block m , the ^ 308 checks for the receipt of the 
now directed to obtain, over Path "C," the product informa- meS sage packet 400. If a message packet 400 is not received, 
tion relevant to the particular advertiser server 312 location program flow moves along the "N" path to continue waiting 
information embedded in message packet 404. Referring f or the message. If the message packet 400 is received, 
now to FIG. 4c, the message packet 404 for this transaction 30 program flow continues along path "Y" for message pro- 
comprises the URL of the advertiser server 312, the request- cessing. Upon receipt of the message packet 400, in function 
for-product-information data, and the address of the source block 602, the ARS 308 decodes the message packet 400. 
PC 302. Th e product code is then extracted independently in function 

Upon receipt of the message packet 404 from source PC block 604 in preparation for matching the product code with 

302, advertiser server 312 disassembles the message packet 35 the appropriate advertiser server address located in the 

404 to obtain the request-for-product-information data. The database 310. In function block 606, the product code is then 

advertiser server 312 then retrieves the particular product used with a look-up table to retrieve the advertiser server 

information from its database, and transmits it over Path "D" 312 URL of the respective product information contained in 

back to the source PC 302. Referring now to FIG. 4d, the the audio signal data. In function block 608, the ARS 308 

message packet 406 for this particular transaction comprises 40 then assembles message packet 402 for transmission back to 

the address of the source PC 302, the requested information, the source PC 302. Function block 610 indicates the process 

and the URL of the advertiser server 312. of sending the message packet 402 back to the source PC 

Optionally, the ARS 308 may make a direct request for 302 over Path "B." 

product information over Path "E" to advertiser server 312. Referring now to FIG, 7, there is illustrated a flowchart of 

In this mode, the ARS 308 sends information to the adver- 45 the interactive processes between thc source PC 302 and the 

tiser server 312 instructing it to contact the source PC 302. advertiser server 312. In function block 700, the source PC 

This, however, is unconventional and requires more com- 302 receives the message packet 402 back from the ARS 308 

plex software control. The message packet 408 for this and begins to decode the packet 402. In function block 702, 

transaction is illustrated in FIG. 4e, which comprises the the URL of the advertiser product information is extracted 

URL of the advertiser server 312, the request-for-product- 50 from the message packet 402 and saved for insertion into the 

information data, and the address of the source PC 302. message packet 404 to the advertiser server 312. The mes- 

Since product information is not being returned to the ARS sage packet 404 is then assembled and sent by the source PC 

308, but directly to the source PC 302, the message packet 302 over Path "C" to the advertiser server 312, n function 

408 requires the return address to be that of the source PC block 704. While the source PC 302 waits, in function block 

302. The product information is then passed directly to PC 55 706, the advertiser server 312 receives the message packet 

302 over Path "D." 404 from the source PC 302, in function block 708, and 

Referring now to FIG. 5, the method for detecting and disassembles it. The product information location is then 
obtaining product information is as follows. In decision extracted from the message packet 404 in function block 
block 500, a proprietary application running resident on a 710. Thc particular product information is retrieved from thc 
source computer PC 302 (similar to PC 204) monitors the 60 advertiser server 312 database for transmission back to the 
audio input for a special trigger signal. Upon detection of the source PC 302. In function block 712, the product informa- 
trigger signal, data following the trigger signal is decoded tion is assembled into message packet 406 and then trans- 
fer further processing, in function block 502. In function mitted back to the source PC 302 over Path "D." Returning 
block 504, the data is buffered for further manipulation. In to the source PC 302 in function block 714, the advertiser 
decision block 506, a determination is made as to whether 65 product information contained in the message packet 406 
the data can be properly authenticated. If not, program flow received from the advertiser server 312, is then extracted and 
continues through the "N" signal to function block 520 processed in function block 716. 
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Referring now to FIG. 8, after receipt of a trigger signal, 
a web browser application on a source PC 302 is automati- 
cally launched and computer display 800 presents a browser 
page 802. Proprietary software running on the source PC 
302 processes the audio signal data after being digitized 5 
through the sound card 206. The software appropriately 
prepares the data for insertion directly into the web browser 
by extracting the product information code and appending 
keystroke data to this information. First, a URL page 804 is 
opened in response to a Ctrl-0 command added by the 10 
proprietary software as the first character string. Opening 
URL page 804 automatically positions the cursor in a field 
806 where additional keystroke data following the Ctrl-0 
command will be inserted. After URL page 804 is opened, 
the hypertext protocol preamble http:// is inserted into the 15 
field 806. Next, URL information associated with the loca- 
tion of the ARS 308 is inserted into field 806. Following the 
ARS 308 URL data are the characters /? to allow entry of 
variables immediately following the /? characters. In this 
embodiment, the variable following is the product informa- 2 o 
tion code received in the audio signal. The product code 
information also provides the cross-reference information 
for obtaining the advertiser URL from the ARS database 
310. Next, a carriage return is added to send the URL/ 
product data and close the window 804. After the message 2 s 
packet 400 is transmitted to the ARS 308 from the source PC 
302, transactions from the ARS 308, to the source PC 302, 
to the advertiser server 312, and back to the source PC 302, 
occur quickly and are transparent to the viewer. At this point, 
the next information the viewer sees is the product infor- 30 
mation which was received from the advertiser server 312. 

Referring now to FIG. 9, there is illustrated a block 
diagram of a more simplified embodiment. In this 
embodiment, a video source 902 is provided which is 
operable to provide an audio output on an audio cable 901 35 
which provides routing information referred to by reference 
numeral 904. The routing information 904 is basically 
information contained within the audio signal This is an 
encoded or embedded signal. The important aspect of the 
routing information 904 is that it is automatically output in 40 
realtime as a function of the broadcast of the video program 
received over the video source 902. Therefore, whenever the 
program is being broadcast in realtime to the user 908, the 
routing information 904 will be output whenever the pro- 
ducer of the video desires it to be produced. It should be 45 
understood that the box 902 representing the video source 
could be any type of media that will result in the routing 
information being output. This could be a cassette player, a 
DVD player, an audio cassette, a CD ROM or any such 
media. It is only important that this is a program that the 50 
producer develops which the user 908 watches in a continu- 
ous or a streaming manner. Embedded within that program, 
at a desired point selected by the producer, the routing 
information 904 is output. 

The audio information is then routed to a PC 906, which 55 
is similar to the PC 112 in FIG. 1. A user 908 is interfaced 
with the PC to receive information thereof, the PC 906 
having associated therewith a display (not shown). The PC 
906 is interfaced with a network 910, similar to the network 
306 in FIG. 3. This network 910 has multiple nodes thereon, 60 
one of which is the PC 906, and another of which is 
represented by a network node 912 which represents remote 
information. The object of the present embodiment is to 
access remote information for display to the user 908 by the 
act of transmitting from the video program in block 902 the 65 
routing information 904. This routing information 904 is 
utilized to allow the PC 906 which has a network "browser** 



running thereon to "fetch" the remote information at the 
node 912 over the network 910 for display to the user 908. 
This routing information 904 is in the form of an embedded 
code within the audio signal, as was described hereinabove. 

Referring now to FIG. 10, there is illustrated a more 
detailed block diagram of the embodiment of FIG. 9. In this 
embodiment, the PC 906 is split up into a couple of nodes, 
a first PC 1002 and a second PC 1004. The PC 1002 resides 
at the node associated with the user 908, and the PC 1004 
resides at another node. The PC 1004 represents the ARS 
308 of FIG. 3. The PC 1004 has a database 1006 associated 
therewith, which is basically the advertiser database 310. 
Therefore, there are three nodes on the network 910 neces- 
sary to implement the disclosed embodiment, the PC 1002, 
the PC 1004 and the remote information node 912. The 
routing information 904 is utilized by the PC 1002 for 
routing to the PC 1004 to determine the location of the 
remote information node 912 on the network 910. This is 
returned to the PC 1002 and a connection made directly with 
the remote information node 912 and the information 
retrieved therefrom to the user 908. The routing information 
904 basically constitutes primary routing information. 

Referring now to FIG. 11, there is illustrated a diagram- 
matic view of how the network packet is formed for sending 
the primary routing information to the PC 1004. In general, 
the primary routing information occupies a single field 
which primary routing information is then assembled into a 
data packet with the secondary routing information for 
transfer to the network 910. This is described hereinabove in 
detail. 

Referring now to FIG. 12, there is illustrated an alternate 
embodiment to that of FIG. 9. In this embodiment, the video 
source 902 has associated therewith an optical region 1202, 
which optical region 1202 has disposed therein an embedded 
video code. This embedded video code could be relatively 
complex or as simple as a grid of dark and white regions, 
each region in the grid able to have a dark color for a logic 
"1" or a white region for a logic "0." This will allow a digital 
value to be disposed within the optical region 1202. A sensor 
1204 can then be provided for sensing this video code. In the 
example above, this would merely require an array of optical 
detectors, one for each region in the grid to determine 
whether this is a logic "1" or a logic "0" state. One of the 
sensed video is then output to the PC 906 for processing 
thereof to determine the information contained therein, 
which information contained therein constitutes the primary 
routing information 904. Thereafter, it is processed as 
described hereinabove with reference to FIG. 9. 

Referring now to FIG. 13, there is illustrated a block 
diagram for an embodiment wherein a user's profile can be 
forwarded to the original subscriber or manufacturer. The 
PC 906 has associated therewith a profile database 1302, 
which profile database 1302 is operable to store a profile of 
the user 908. This profile is created when the program, after 
initial installation, requests profile information to be input in 
order to activate the program. In addition to the profile, there 
is also a unique ID that is provided to the user 908 in 
association with the browser program that runs on the PC 
906. This is stored in a storage location represented by a 
block 1304. This ID 1304 is accessible by a remote location 
as a "cookie" which is information that is stored in the PC 
906 in an accessible location, which accessible location is 
actually accessible by the remote program running on a 
remote node. 

The ARS 308, which basically constitutes the PC 1004 of 
FIG. 10, is operable to have associated therewith a profile 
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database 1308, which profile database 1308 is operable to 
store profiles for all of the users. The profile database 1308 
is a combination of the stored in profile database 1302 for all 
of the PCs 906 that are attachable to the system. This is to 
be distinguished from information stored in the database 
310, the advertiser's database, which contains intermediate 
destination tables. When the routing information in the 
primary routing information 904 is forwarded to the ARS 
308 and extracted from the original data packet, the look-up 
procedure described hereinabove can then be performed to 
determine where this information is to be routed. The profile 
database 1302 is then utilized for each transaction, wherein 
each transaction in the form of the routing information 
received from the primary routing information 904 is com- 
pared to the destination tables 310 to determine what manu- 
facturer it is associated with. The associated ID 1304 that is 
transmitted along with the routing information in primary 
routing information 904 is then compared with the profile 
database 1308 to determine if a profile associated therewith 
is available. This information is stored in a transaction 
database 1310 such that, at a later time, for each routing code 
received in the form of the information in primary routing 
information 904, there will associated therewith the IDs 
1304 of each of the PCs 906. The associated profiles in 
database 1308, which are stored in association with IDs 
1304, can then be assembled and transmitted to a subscriber 
as referenced by a subscriber node 1312 on the network 910. 
The ARS 308 can do this in two modes, a realtime mode or 
a non-realtime mode. In a realtime mode, each time a PC 
906 accesses the advertiser database 310, that user's profile 
information is uploaded to the subscriber node 1312. At the 
same time, billing information is generated for that sub- 
scriber 1312 which is stored in a billing database 1316. 
Therefore, the ARS 308 has the ability to inform the 
subscriber 1312 of each transaction, bill for those 
transactions, and also provide to the subscriber 1312 profile 
information regarding who is accessing the particular prod- 
uct advertisement having associated therewith the routing 
information field 904 for a particular routing code as 
described hereinabove. This information, once assembled, 
can then be transmitted to the subscriber 1312 and also be 
reflected in billing information and stored in the billing 
information database 1316. 

Referring now to FIG. 14, there is illustrated a flowchart 
depicting the operation for storing the profile for the user. 
The program is initiated in a block 1402 and then proceeds 
to a function block 1404, wherein the system will prompt for 
the profile upon initiation of the system. This initiation is a 
function that is set to activate whenever the user initially 
loads the software that he or she is provided. The purpose for 
this is to create, in addition to the setup information, a user 
profile. Once the user is prompted for this, then the program 
will flow to a decision block 1406 to determine whether the 
user provides basic or detailed information. This is select- 
able by the user. If selecting basic, the program will flow to 
a function block 1408 wherein the user will enter basic 
information such as name and serial number and possibly an 
address. However, to provide some incentive to the user to 
enter more information, the original prompt in function 
block 1404 would have offers for such things as coupons, 
discounts, etc, if the user will enter additional information. 
If the user selects this option, the program from the decision 
block 1406 to a function block 1410. In the function block 
1410, the user is prompted to enter specific information such 
as job, income level, general family history, demographic 
information and more. There can be any amount of infor- 
mation collected in this particular function block. 
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Once all of the information is collected, in either the basic 
mode or the more specific mode, the program will then flow 
to a function block 1412 where this information is stored 
locally. The program then flows to a decision block 1414 to 

5 then go on-line to the host or the ARS 308. In general, the 
user is prompted to determine whether he or she wants to 
send this information to the host at the present time or to 
send it later. If he or she selects the "later" option, the 
program will flow to a function block 1415 to prompt the 

10 user at a later time to send the information. In the disclosed 
embodiment, the user will not be able to utilize the software 
until the profile information is sent to the host. Therefore, the 
user may have to activate this at a later time in order to 
connect with the host. 

is If the user has selected the option to upload the profile 
information to the host, the program will flow to the function 
block 1416 to initiate the connect process and then to a 
decision block 1418 to determine if the connection has been 
made. If not, the program will flow along a "N" path to a 

20 time to decision block 1420 which will time to an error block 
1422 or back to the input of the connect decision block 1418. 
The program, once connected, will then flow along a "Y" 
path from decision block 1418 to a function block 1428 to 
send the profile information with the ID of the computer or 

25 user to the host. The ID is basically, as described 
hereinabove, a "cookie" in the computer which is accessed 
by the program when transmitting to the host. The program 
will then flow to a function block 1430 to activate the 
program such that it, at later time, can operate without 

30 requiring all of the set up information. In general, all of the 
operation of this flowchart is performed with a "wizard" 
which steps the user through the setup process. Once 
complete, the program will flow to a Done block 1432. 
Referring now to FIG. 15, there is illustrated a flowchart 

35 depicting the operation of the host when receiving a trans- 
action. The program is initiated at a start block 1502 and 
then proceeds to decision block 1504, wherein it is deter- 
mined whether the system has received a routing request, 
i.e., the routing information 904 in the form of a tone, etc., 

40 embedded in the audio signal as described hereinabove with 
respect to FIG. 9. The program will loop back around to the 
input of decision block 1504 until the routing request has 
been received. At this time, the program will flow along the 
"Y" path to a function block 1506 to receive the primary 

45 routing information and the user ID. Essentially, mis pri- 
mary routing information is extracted from the audio tone, 
in addition to the user ID. The program then flows to a 
function block 1508 to look up the manufacturer URL that 
corresponds to the received primary routing information and 

50 then return the necessary command information to the 
originating PC 108 in order to allow that PC to connect to 
the destination associated with the primary routing informa- 
tion. Thereafter, the program will flow to a function block 
1510 to update the transaction database 1310 for the current 

55 transaction. In general, the routing information 904 will be 
stored as a single field with the associated IDs. The profile 
database, as described hereinabove, has associated therewith 
detailed profiles of each user on the system that has activated 
their software in association with their ID. Since the ID was 

60 sent in association with the routing information, what is 
stored in the transaction database is the routing code, in 
association with all of the IDs transmitted to the system in 
association with that particular routing code. Once this 
transaction database has been updated, as described 

65 hereinabove, the transactions can be transferred back to the 
subscriber at node 312 with the detailed profile information 
from the profile database 1308. 
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The profile information can be transmitted back to the the network, obtain information from a remote location 

subscriber or manufacturer in the node 312 in realtime or typically controlled by the advertiser. This could be in the 

non-realtime. A decision block 1512 is provided for this, form of an advertisement of a length longer than that 

which determines if the delivery is realtime. If realtime, the contracted for. Further, this could be an interactive type of 

program will flow along a " Y" path to a function block 1514 5 advertisement. An important aspect to the type of interaction 

wherein the information will be immediately forwarded to between the actual broadcasl pr0 gram with the embedded 

the manufacturer or subscriber. The program will then flow routi information and the manufacturer's site is the fact 

to a function block 1516 wherein the billing for that par- tha( lhere fa ided in the informatioD ^ lo the user > s PC 

ticular manufacturer oi -subscriber will be updated in the and a profile 0 f the user themselves. Therefore, an advertiser 

bilhng database 1316. The program will then flow into an 1Q can actual , ^ realtime information „ t0 the number of 

End block 1518. If it was non-realtime the program moves individuals that are watchi their licular advertiseraent 

along the N path to a function block 1520 wherein it is set and alsQ informalion as t0 the background of those 

for a later delivery and it is accrued in the transaction individuals? demograp hic information, etc. This can be a 

database. In any event, the transaction database will accrue va \u<ib\t asset to an advertiser 

all information associated with a particular routing code. 1C , . t 

,, 7 . 4 , u . 4 4 . c c ^ In another example, the producer of the program, whether 

With a realtime transaction, it is possible for a manufac- . , . r * r 

, , . ■ * i i it be an on-air program, a program embedded in a video tape, 

turer to place an ad in a magazine or to place a product on r,™, t^/t^ Z, n .u . * 

, tc \ 4t c I *u * CD-ROM, DVD, or a cassette, can allow the user to auto- 

a shelf at a particular time. The manufacturer can thereafter 4 . „ JJV - 4 . 4 , 4 . 4 , , 

. 4 , V , . 4 , 4 , , 4l _ . 4 matically access additional information that is not displayed 

monitor the times when either the ads are or the products are i * ■ 

, , „ c t , 4 . , . 4 r 4 on the screen. For example, in a sporting event, various 

purchased. Of course, they must be scanned into a computer - n 4 . . , , : ' 5 & 4 ' 

r ,. , .„ -j j i o *u e \ 20 statistics can be provided to the user from a remote location, 

which will provide some delay. However, the manufacturer . , lL . 4 , . . , 

1 4 . /, j * ■ i- merely by the viewer watching the program. When these 

can gain a very current view of how a product is moving. For 4 . /. J , t , , *» . y 6 , ... . 4 , 

t c t c * . • j statistics are provided, the advertiser can be provided with 

example, if a cola manufacturer were to provide a promo- , . • • * \- JL i I • e 

i j . r • demographic information and background information 

tional advertisement on, for example, television, indicating f. 4l _ „, . , . . . r i 

4 , , , • i j i i * 4 i 4 regardmg the user. This can be important when, for example, 

that a new cola was going to be placed on the shelf and that , A tr , c 

c * 1 c\r\f\ , c r , 4l _ . , 25 the user may record a sports program. If the manufacturer 

the first 1000 purchasers, for example, scanning their code . ± l j • i_ ■ * * r 

. 44l _ ^ i u • u £ t t. see s that this program routing code is being output from 

into the network would receive some benefit, such as a , . : r\ , , 6 , r , 1f 

, 4 . 4 £ 4 . „. \ . some device at a later time than the actual broadcast itself, 

chance to win a trip to some famous resort in Honda or some 4l _. , ^. „ , 4t _ . 

4l _ . . 4l f c 4 , , this allows the advertisers to actually see that their program 

other incentive, the manufacturer would have a very good . , . , . , , 4 4 J - . . , , . to . 

. j 4 , n 4t _ , ^. 4 . , / °, is still being used and also what type of individual is using 

idea as to how well the advertisement was received. Further, 7n . 4 A . .1.1.1- j . u j . • , L 

4| _ . . . , , 4l _ 4 . 1 / 30 it. Alternatively, the broadcaster could de term me the same 

the advertiser would know where the receptive markets , 4 „ , .„ 4 . , , c , 4 

Fr.u- j r , u j 1 j *u * 1 anc » actually bill the advertiser an additional sum for a later 

were. If this advertiser, for example, had placed the televi- , , 4 . „ , 4 4l _ 4 . 4 . 

, 4 . . 4 . . r . . r , . 1 • broadcast. This is all due to the fact that the routing 

sion advertisement in ten cities and received overwhelming . c . 4 . . , , ■ . .*? 

r % , 4 r #u 0 information automatically, through a PC and a network, will 

response from one city, but very poor response from another ., . . 4 4 *' , & . - .... 

./ , tJ 4 . / • i- /■ . u v .u . provide an indication to the advertiser for other intermediary 

city, he would then have some inclination to believe that ^ r ,. 4 , . . , ■ c 

plV L r „„ 0 rornnnrfl _ t „ rt * , t ^„ f , ot 33 regarding the time at which the actual information was 

either one poor response city was not a good market or that broadcast 

the advertising medium he had chosen was very poor. Since 

the advertiser can obtain a relatively instant response and The different type of medium that can be utilized with the 

also content with that response as to the demographics of the above embodiment are such things as advertisements, which 

responder, very important information can be obtained in a 40 are discussed hereinabove, contests, games, news programs, 

relatively short time education, coupon promotional programs, demonstration 

It should be noted that the disclosed embodiment is not media ( demos )' Photographs, all ofwhich can be broadcast 

limited to a single source PC 302, but may encompass a °", a P nvat « ate °\ ? V^hcalc This all will prov.de the 

Urge number of source computers connected over a global ablh, y t0 allow re f altim l e \ nterfac p Wl,h th f ? e i work and tl * 

communication network. Additionally, the embodiment is 45 r t mot ?, locatlon f ? r ° b ' am .' n g lhf < routed wformatton and 

not limited to a single ARS 308 or a single advertiser server ako allow for realtune blUm S and a «=ounting. 

312, but may include a plurality of ARS and advertiser Although the preferred embodiment has been described in 

systems, indicated by the addition of ARS 314 and advertiser detail . il should be understood that various changes, subsli- 

server A 316, respectively. It should also be noted that this unions and alterations can be made therein without depart- 

embodiment is not limited only to global communication 50 in S from the s P irit and sc °pe of the invention as defined by 

networks, but also may be used with LAN, WAN, and the appended claims, 

peer-to-peer configurations. Wnat is claimed is: 

It should also be noted that the disclosed embodiment is L A method for controlling a computer disposed at a user 

not limited to a personal computer, but is also applicable to, location on a network, comprising the steps of: 

for example, a Network Computer ("NetPC"), a scaled- 55 inputting an analog signal at the user location on the 

down version of the PC, or any system which accommodates network, the analog signal comprising a commerce 

user interaction and interfaces to information resources. identifier, which commerce identifier has an association 

One typical application of the above noted technique is witD information disposed on a remote information 

for providing a triggering event during a program, such as a provider location on the network; 

sport event. In a first example, this may be generated by an 60 in response to the step of inputting; 

advertiser. One could imagine that, due to the cost of appending routing information to the commerce 

advertisements in a high profile sports program, there is a identifier, which routing information defines the 

desire to utilize this time widely. If, for example, an adver- location of the remote information provider location 

tiser contracted for 15 seconds worth of advertising time, on the network; 

they could insert within their program a tone containing the 65 creating a link between the user location and the remote 

routing information. This routing information can then be information provider location over the network in 

output to the user's PC which will cause the user's PC to, via accordance with the appended routing information, 
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which routing information defines the network con- encoded signal, and providing it at the personal com- 

nection between the user location and the remote puter for use by the user. 

location on the network; and 8. The method of claim 7, wherein the personal computer 

transmitting the commerce identifier from the user has a display associated therewith, wherein the retrieved 

location to the remote information provider location 5 information is displayed on the display, 

over the network utilizing the created link, wherein . 9 The method of claim 7, wherein the broadcast program 

the information associated with the commerce iden- 1S a v *deo program. 

tifier can be returned to the user location from the 10 J** me ' hod of claim 7 ' wherein the broadcast pro- 
remote information provider location. S ram ^ audio program. . 

2. The method of claim 1, wherein the analog signal is 10 11 The meth ° d of cla 1 un J> wherein the encoded signal 

, , . & & comprises an audio signal and wherein the step of extracting 

input to a sound card on the computer comprises decoding the unique identifier information in the 

3. The method of claim 1, wherein the step of appending audio s{ { b tne & J e^pm^ 

routing information composes the steps of: u ^ method of daim n wherein ^ broadcast 

providing a database of routing information at a second- program is a video program. 

ary location on the network which provides an asso- 15 13, The method of claim 11, wherein the broadcast 

ciation between a predetermined commerce identifier program is an audio program. 

and a predefined remote information provider location 14 me thod of claim 11, wherein the step of extracting 

on the network, there being a plurality of such routing routing information comprises connecting the video source 

information stored in the database; to me personal computer with a cable which carries at least 

transmitting to the secondary location on the network the 20 audio information, the personal computer then decoding 

commerce identifier; from the audio information in the step of extracting the 

accessing the database in response to receiving at the unique identifier information from the encoded signal, 

secondary location a transmitted commerce identifier I 5 The method of claim 7, wherein the encoded signal is 

from the user location; a video signal and the broadcast program is a video program 

comparing the received' commerce identifier with the * a f d th r e ste F ' of Acting comprises extracting the unique 

stored routing information in the database; lde " ,lf ^ r infol ™|'° n from ' he v > de ° encoded s,gnal. 

.„,. , . 16. The method 01 claim 7, wherein the storage region is 

V* " T « et r en ! rC • T mmerce disposed on a remote information provider location on the 

identifier and any of the stored routing information, netWQrk an(J (he of controllm comprises: 

transmitting the matching routing information back to 30 4 . t , * A . . * . c 

iL , j transferring the extracted unique identifier information to 

the user location; and • * j- t j it ? . 1 

an intermediate node on the network; 

at the user location, in response to receiving the matching s(ori a , , he intermediate node on the network lookup 

routing information, appending the matching routing information associated with the location of the storage 

mformation to the commerce identifier. ioQ 0Q (he netwofk with , he uni identifier 

4. The method of claim 3 and further comprising the step 35 mformation such that the unique identifier information 
of delaying the received mformation from the remote ^ assocjated ^ tne location of the st „ ion on 
information provider location. tne ne t WO rk' 

5. The method of claim 1, wherein the network is a global , . . ,. . , , . 4 , , 

, it _\ , & looking up at the intermediate node the associated loca- 

commumcation network that provides a universal resource r • j 

t , /nm\r u * ■ r j 1 an tion of the storage region for the received unique 

locator (URL) tor each remote information provider location 4U . c *? & , ^ . . , , . . 7 

v 4 \ , iL ■ r *■ • j c identifier information and returning the location lnfor- 

on the network and the routine mformation is comprised of . ... i « 

tU Iim , 4 , . • r *• j i mation to the personal computer; and 

the URL for the remote information provider location. f r r „. f , , . . _ 

6. The method of claim 1, wherein the appended routing the ste P of controlling using the returned location infor- 
information in the step of appending includes instructional mation to retrieve information from the storage region 
information as to how the remote information provider « at the defined remote mformation provider location on 
location is to process the transmitted commerce identifier. . nelworK - _ , . „ ^ , ,. , 

7. A method for retrieving information from a storage 17 J** method of claim 16 and further compnsmg the 
region having a defined information provider location on a ste P of stonng at the mtermediate node profile information 
network, comprising the steps of: associated with the user of the personal computer and 

, , , , , 50 storing at the personal computer identification information 

broadcasting a program having embedded therein an associated ^ the ofile Motion at the intermediate 

encoded signal having unique identifier information ^ ^ furmer risi lhe st of transmitting the 

contained therein, wherein the unique identifier has an ideDtilication m f orma tion to the intermediate node when 

association with the location on the network of the transmitting the unique identiner information thereto, 

storage region; 5s lg ^ method of c]aim 17 and further compr ising the 

extracting the encoded signal from the broadcast; and step 0 f transmitting profile information from the intermedi- 

controlling a personal computer for a user at a user ate node to the personal computer with the returned routing 

location on the network in response to the step of information, such that profile information is transmitted with 

extracting to connect to the storage region on the the unique identifier information from the personal computer 

network and retrieve information from the storage 60 to the defined location on the network, 
region at the defined location thereof on the network, 

which defined location is located with the extracted ***** 
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